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MOTION IMAGE CODING APPARATUS FOR 
PERFORMING HIERARCHICAL CODING 

This application is a continuation of application Ser. No. 
09/917.955, filed Jul. 31, 2001, now U.S. Pat. No. 6,546, 
142, which is a Divisional of Sen No. 09/202,678, filed Dec. 
18, 1998, now U.S. Pat. No. 6,295,381, which is a 371 of 
PCT/JP97/0154O filed May 7, 1997, the entire contents of 
which are hereby incorporated by reference in this applica- 
tion. 

TECHNICAL HELD 

The present invention relates to an image coding appara- 
tus and an image decoding apparatus, and more particularly 
to a motion image coding apparatus for coding image data 
in an efficient manner and a motion image decoding appa- 
ratus for decoding the coded data generated by the motion 
image coding apparatus, used in the field of digital image 
processing. 

BACKGROUND ART 

In image coding, a method of superimposing different 
motion image sequences has been considered. An article 
titled "An Image Coding Scheme Using Layered Represen- 
tation and Multiple Templates" (Technical Report of lEICE, 
IE94-159, pp. 99-106 (1995)) describes a scheme for super- 
imposing a motion image sequence as a background and 
another motion image sequence of a component or part 
image (e.g., video image of a human figure or fish cut out by 
chromakey technique) as a foreground, to generate a new 
image sequence. 

FIG. 12 is a block diagram showing a coding apparatus 
and a decoding apparatus according to the conventional art. 
A pixel data coding portion 1201 in FIG. 12 is a portion for 
coding pixel data representing intensity and color difference, 
and a shape data coding portion 1202 is for coding shape 
data representing a shape of part image. These portions 
constitute an apparatus for coding a part image. 

Shape data are used for coding pixel data. A pixel data 
decoding portion 1203 in FIG. 12 is a portion for decoding 
pixel data, and a shape data decoding portion 1204 is for 
decoding shape data. These portions constitute an apparatus 
for decoding a part image. For decoding pixel data, decoded 
shape data are used. 

Shape data coding portion 1202 first expresses a contour 
of a shape using 8 directional chain codes, for example, and 
then codes the chain codes by Huffman coding. Pixel data 
coding portion 1201 codes pixel data by the international 
standard method of coding motion images, such as MPEG or 
H.261. When pixel data are divided into blocks, an arbitrary 
shape DCT technique or the like is employed for the block 
including a boundary of part image. 

Each part image is decoded by a decoding apparatus, and 
then superimposed at a superimposing portion (not shown) 
using shape data, and displayed on a device fike a display. 
For example, when superimposing a part image p (i, j) in 
arbitrary shape on a rectangular background image b (i, j), 
a display image f (i, j) is generated using shape data s (i, j) 
according to the following expression (1): 

}>p{h Mh jy^Kiy m-s{h m ci) 

wherein (i, j) represents a coordinate of a pixel, and f (i, j) 
represents a pixel value, s (i, j) assumes the value "1** within 
a part image, and "0" outside the part image. 

In the conventional art, however, there has not been 
proposed a technique for setting up spatial hierarchy for a 
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part image. The international standard MPEG2 method 
realizes hierarchy (i.e., spatial hierarchy) over an entire 
image. In the method, data in a lower layer having low 
spatial resolution throughout the entire image and data in an 

5 upper layer for improving the resolution are decoded 
together to achieve high spatial resolution. 

Accordingly, an object of the present invention is to 
provide an image coding apparatus and an image decoding 
apparatus that can realize spatial hierarchy in a part image. 

10 To obtain shape data of low resolution, high-resolution 
shape data obtained by the conventional art may simply be 
thinned out. However, if thus obtained low-resolution image 
is displayed on a large-screen monitor having low 
resolution, the contour of a part will have stepwise 

15 appearance, which leads to deterioration in psychic image 
quality. The same problem arises when a low-resolution 
image is enlarged for display on a large-screen monitor 
having high resolution. 
Accordingly, another object of the present invention is to 

20 provide an image coding apparatus and an image decoding 
apparatus that can solve the above problem. 

DISCLOSURE OF THE INVENTION 

In the present invention, an image coding apparatus and 
an image decoding apparatus as described in the following 
(1) through (10) are provided to solve the above-described 
problems. 

(1) An image coding apparatus performing bwer layer 
coding for coding a part image in arbitrary shape in low 
resolution and upper layer coding for coding the part image 
in high resolution, comprising: a first shape data generating 
portion for generating low-resolution shape data represent- 
ing the arbitrary shape; a first shape data coding portion for 
coding the generated low-resolution shape data; a second 
shape data generating portion for generating high-resolution 
shape data representing the arbitrary shape; and a second 
shape data coding portion for coding the generated high- 
resolution shape data; wherein the low-resolution shape data 
are used for coding the part image in the lower layer, and the 
high-resolution shape data and the decoded part image data 
in the lower layer are used for coding the part image in the 
upper layer. 

(2) The image coding apparatus according to (1), wherein 
45 the second shape data coding portion codes information on 

difference between the high-resolution shape data and the 
low-resolution shape data. 

(3) An image coding apparatus performing lower layer 
coding for coding a part image in arbitrary shape in low 

50 resolution and upper layer coding for coding the part image 
in high resolution, wherein high resolution shape data of the 
part image are shared by the upper and lower layers; the 
apparatus comprising a high-resolution shape data generat- 
ing portion for generating high -resolution shape data of the 

55 part image, and a shape data coding portion for coding the 
generated high-resolution shape data; wherein high resolu- 
tion shape data having N levels of gradation (N is at least 2) 
are transformed to low-resolution shape data having M 
levels of gradation (M>N), the low-resolution shape data are 

60 used for coding the part image in the lower layer, and the 
high-resolution shape data and the decoded part image data 
in the lower layer are used for coding the part image in the 
upper layer. 

(4) An image decoding apparatus for decoding data coded 
65 by the image coding apparatus according to (1), performing 

lower layer decoding for decoding a part image in arbitrary 
shape in low resolution and upper layer decoding for decod- 
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ing the part image in high resolution; the apparatus com- performing lower layer decoding for decoding a part image 

prising: a first shape data decoding portion for decoding in arbitrary shape in low resolution and upper layer decoding 

low-resolution shape data, and a second shape data decoding for decoding the part image in high resolution; the apparatus 

portion for decoding high-resolution shape data; the low- comprising: a first shape data decoding portion for decoding 

resolution shape data are used for decoding the part image s low-resolution shape data, and a second shape data decoding 

m the lower layer, and the high -resolution shape data and the po^io^ for decoding high-resolution shape data; wherein the 

deSfiC "^t'^^a e in Ve \ '''' low-resolution shape data are used for decoding the part 

eco ing e par image la e upper ayer. image in the lower layer, and the high-resolution shape data 

An unage decodrng apparatus tor decodimg data coded ^^^^^ , 

in the lower layer are used 

WrMvefH" h""^ apparatus according to (2), perfonnmg j„ fo, ^^^^ ^j^'' , ^^^^ 
lower layer deoodmg for decoding a part image m arbitrary ■ j, ? j- • r .• j-n- 
shape in low resolution and upper layer decodfag for decod- f^T ^''^,^'^"1^. portion uses mformauon on difference 
ing the part image in high resolution; the apparatus com- h>gh-resolution shape data and the low- 
prising: a first shape data decoding portion for decoding reso'^wn shape data to obtain high-resolution shape data; 
low-resolution shape data, and a second shape data decoding '^5 ^''*P'= decodmg portion has a mode for 
portion for decoding high-resolution shape data; wherein the " decoding high-resolution shape data corresponding to a 
low-resolution shape data are used for decoding the part Port'O" part image coded in the lower layer, and, when 
image in the lower layer, and the high-resolution shape data selected, decodes the high-resolution shape data 
and the decoded part image data in the lower layer are used ^dependent of the low-resolution shape data, 
for decoding the part image in the upper layer; and the BRIEF DESCRIPTION OF THE DRAWINGS 

Ti^Snf between trSre'^ljlnThapf Ztd th^ ' f ^ ^'f '^^r '^71' ' ^P^'™ 

low-resolution shape data'to obtain high resolution shape "^'I'^f.'' f^*t embodm^ent of the present invention. 

^^^^ FIG. 2 IS a block diagram showing a decoding apparatus 

^'fi^ At, ;,v,^™^o^«^;« ^ PA J J » A A according to the first embodiment of the present invention. 

[6; An image decoding apparatus for decoding data coded 5'. , , . . 

by the image coding apparatus according to (3), performing ^ ^ ^ ^^^""^ diagram showmg a codmg apparatus 

lower layer decoding for decoding a part image in arbitrary according to a second embodiment of the present invention, 

shape in low resolution and upper layer decoding for decod- \ ^^^^ ^'^^'^^ diagram showing a decoding apparatus 

ing the part image in high resolution; wherein high resolu- according to the second embodiment of the present inven- 
tion shape data of the part image are shared by the lower and 

upper layers; the apparatus comprising a shape data decod- PIG- 5 is a block diagram showing a coding apparatus 

ing portion for decoding high-resolution shape data; wherein according to a third embodiment of the present invention, 

high resolution shape data with N levels of gradation (N is FIG. 6 is a block diagram showing a decoding apparatus 

at least 2) are transfonned to low-resolution shape data with for a lower layer according to the third embodiment of the 

M levels of gradation (M>N), the transformed shape data are present invention. 

used for decoding the part image in the lower layer, and the FIG. 7 is a diagram for use in illustrating information on 

high-resolution shape data and the decoded part image in the difference between upper layer shape data and lower layer 

lower layer are used for decoding the part image in the upper shape data. 

^^y^^' FIGS. 8A through 8D are diagrams for use in illustrating 

(7) The image coding apparatus according to (1), wherein 4^ a technique for obtaining low-resolution shape data from 
the second shape data generating portion has a mode for high-resolution shape data according to the present inven- 
gene rating high-resolution shape data corresponding to a tion. 

portion of the part image coded in the lower layer. piG. 9 is a block diagram showing a coding apparatus 

(8) The image coding apparatus according to (2), wherein according to another embodiment of the present invention, 
the second shape data generating portion has a mode for 45 FIG. 10 is a block diagram showing an example of an 
generating high-resolution shape data corresponding to a apparatus for performing hierarchical coding of a part image 
portion of the part image coded m the lower layer, and when according to the present invention. 

the mode is selected the second shape data coding portion pj^ ^ ^ ^ ^lock diagram showing a lower layer decod- 

codes the high-resoluuon shape data mdependent of the apparatus according to the present invention, 

low-resolution shape data. co i-* v « ui 1 u ■ 

ro\A' A A- ^ f A A- A . A A 12 is a block diagram showing a codmg apparatus 

(9) An image decodmg apparatus for decoding data coded ^nd a decoding apparatus in the conventional art. 
by the image codmg apparatus accordmg to (7), performing 

lower layer decoding for decoding a part image in arbitrary ^EST MODE FOR CARRYING OUT THE 

shape in low resolution and upper layer decoding for decod- INVENTIGN 

ing the part image in high resolution; the apparatus com- 55 Hereinafter, embodiments of the present invention will be 

prising: a first shape data decoding portion for decoding described, though the present invention is not limited to 

low-resolution shape data, and a second shape data decoding those embodiments. 

portion for decoding high-resolution shape data; wherein the An apparatus shown in FIG. 10 is considered as means for 

low-resolution shape data are used for decoding the part setting up spatial hierarchy in a part image. A down sam- 

image in the lower layer, and the high-resolution shape data eo pling portion 1001 in HG. 10 thins out pixels from input 

and the decoded part image data in the lower layer are used pixel data to lower spatial resolution of the pixel data. A 

for decoding the part image in the upper layer; and the second down sampling portion 1002 thins out pixels from 

second shape data decoding portion has a mode for decoding input shape data to lower spatial resolution of the shape data, 

high-resolution shape data corresponding to a portion of the The shape data show a shape of pan image, and are 

part image coded in the lower layer. ^5 represented as a binary image having a pixel value "1" 

(10) An image decoding apparatus for decoding data within a part and a pixel value "0*' outside the part, for 
coded by the image coding apparatus according to (8), example. 
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Alower layer coding portion 1004 codes pixel data of low extracted by dividing pixel data into areas, for example, 

resolution. For the coding, the international standard method Techniques used for the area dividing include an edge 

of coding motion images, such as MPEG or H.261, is detecting technique using differential operation, and mor- 

employed. When an image is divided into blocks, an arbi- pho logical segmentation. 

trary shape DCT technique or the like is used for a block 5 When cutting out a shape of moving object from a static 
including a boundary of part image. In this case, low- background, dynamic area detection using intra-frame dif- 
resolution shape data output from second down sampling ferences can be utilized. Alternatively, shape data can be 
portion 1002 are used as information on the boundary of the generated by chromakey technique. In FIG. 1, low- 
part image. resolution shape data are obtained after thinning out target 

An upper layer coding portion 1003 codes pixel data of pixel data in a down sampling portion 104 to lower the 
high resolution, in which the international standard method resolution thereof. However, another method may be 
of motion image coding such as MPEG or H.261 is also employed in which shape data are first obtained for high- 
employed. Here, prediction from the decoded images in the resolution pixel data, and the shape data are then thinned out 
lower layer as well as in the upper layer is employed. For the to obtain low-resolution shape data, 
boundary of the part image, high-resolution shape data that The shape data generated here are binary images or 
have not been down sampled are used. ^^^^ ^^^^^ ^^^^ ^^^^^ gradation. In the latter 

A shape data coding portion 1005 codes shape data of case, superimposition of a part image and a background 

high resolution that corresponds to the resolution of the image according to the above expression (1) can be consid- 

upper layer. The contour of a shape is expressed with 8 ered as weighted mean of the part image and the background 

directional Cham codes, for example, and these chain codes image with the shape data being a weight. Note that the 
are coded by Hufl&nan codmg. 20 ^^^^^ ^^^^ ^ ^. ^ expression (1) takes a value "1" 

The coded data arc mtegrated by an mtegration portion within the target part image, "0" outside the part image and 

(not shown), and transmitted or stored. In a decoding a value between «0" and "1" at the boundary portion of the 

apparatus for decoding only a lower layer, as shown in FIG. part image 

11 only the data necessao' for decoding the lower layer are Afirst shape data coding portion 107 codes low-resolution 
picked up &om the coded data havmg those for the upper ^ shape data for a lower layer. If the shape data are binary data, 

and lower layers mtegrated therein, and are used for the ^„ ,h coding. MMR coding, chain coding, or the like is 

acooding process, in otncr words, "coded data ot the lower fo, ^^e coding. If the shape data are expressed with two 

layer pixel data and coded data of the shape data" are or more levels of gradation, a coding schei^e using DCT as 

selected at a selection portion (not shown) and decoded. ^ ^PEG, a coding scher;e using^ quaternary^tree and 

At this time, a shape data decodmg portion 1103 m FTG. vector quantization C'MPEG-4 Video Verification Model 

11 decodes high-resolution shape data. Low- resolution Version 2.0" (ISO/IECTC1/SC29AVG11 N1260)), or the 

shape data are obtained in a down sampling portion 1102, n^r^ 

mr'^ir-r.'" K^'^f/^^ "^^r"^ ^ *hape data generating portion 102 generates 
portion 1002 of FIG. 10. TTius obtained data are used for high-resolution shape da^ for an upper layer from high- 
decoding pixel data in a lower layer decoding portion 1101. ^.olution pixel data. TTie method of generating the shape 

if^ a^aT'"^ for decoding up to an upper layer uses j^ta is same as in the first shape data generating portion 106, 

an ine coaea data to conduct decoding up to the upper layer. ^nd therefore, description thereof is not repeated. A second 

However, the above-descnbed apparatus suffers the fol- shape data coding portion 103 codes the high-resolution 

owmg problem. That is, though conventional decoding of a shape data generated by second shape data generating por- 

lowcr layer only requires shape data of low resolution, the tion 102. The method of coding the shape data is same as in 

above apparatus has to use high-resolution shape data when the first shape data coding portion 107, and description 

coding data m the lower layer, which results in redundant thereof is not repeated. Note that those two shape data 

data. In other words, shape data in an upper layer having a coding portions 103, 107 do not have to use the identical 

large amount of codes should be used mstead of shape data coding method; they may use separate methods for coding, 

m a lower layer with a less amount of codes. Therefore, it instead 

becomes difficult to code a lower layer in good image quality ^n upper layer coding portion 101 codes high-resolution 

With a hmited transnussion or storage capacity. ^1 ^^a- • _f j • .i. • . i 

. pixel data. The coding is performed usmg the internaUonal 

The first and second embodiments of the present mven- standard method of coding motion images, such as MPEG or 

tion aim to solve this problem. h.261, as in the technique described in the Background Art 

BGS. 1 and 2 are block diagrams respectively showing a section. Herein, however, the coding utilizes prediction from 

coding apparatus and a decoding apparatus according to the partially decoded images existing in lower layer coding 

first embodiment, portion 105 in addition to prediction from decoded images 

Referring to FIG. 1, a down sampling portion 104 thins preceding or succeeding in time in the upper layer. For the 
out input pixel data to generate low-resolution pixel data for 55 boundary of part image, high -resolution shape data output 

a lower layer. When thinning out, a low path filter is used to from second shape data generating portion 102 are used, 

prevent aliasing. A lower layer coding portion 105 codes the Next, a decoding apparatus according to the first embodi- 

low-resolution pixel data. ment will be described with reference to HG. 2. 

For coding, the internationally standardized method of Alower layer decoding apparatus 205 consists of portions 
coding motion images, such as MPEG or H.261, is eo surrounded by a broken line in FIG. 2. A first shape data 

employed. When an image is divided into blocks, an arbi- decoding portion 204 decodes coded data of the lower layer 

trary shape DCT technique or the like is employed for a shape data to obtain low-resolution shape data. The decoded 

block mcluding a boundary of part image. For the boundary shape data are sent to a lower layer decoding portion 203, 

of the part image, low-resolution shape data output from a and are also used for display of a lower layer image. Lower 
first shape data generating portion 106 are used. 65 layer decoding portion 203 decodes coded data of the lower 

First shape data generating portion 106 generates low- layer pixel data, and supplies low-resolution pixel data to a 

resolution shape data for a lower layer. Shape data are lower layer display portion (not shown). 
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Next, decoding of an upper layer in FIG. 2 will be 
described. A second shape data decoding portion 202 
decodes coded data of the upper layer shape data to obtain 
high-resolution shape data. The decoded shape data are sent 
to an upper layer decoding portion 201, and also used for 5 
display of an upper layer image. 

Upper layer decoding portion 201 decodes coded data of 
the upper layer pixel data, and supplies high-resolution pixel 
data to an upper layer display portion (not shown). Upper 
layer decoding portion 201 utilizes, as in the upper layer 
coding portion 101 shown in FIG. 1, prediction from the 
decoded images in lower layer decoding portion 203 in 
addition to prediction from the decoded images preceding or 
succeeding in time in the upper layer. 

The second embodiment of the present invention will now 
be described. 

In the first embodiment described above, high-resolution 
shape data used in an upper layer and low-resolution shape 
data used in a lower layer are coded independent of each 
other. Thus, information on the shape data in the lower layer 
is not refleaed to coding of the shape data in the upper layer, 
and therefore, an amount of codes of the shape data in the 
upper layer becomes large. This leads to a problem that a 
total amount of codes for the upper layer increases than in 
the case where the methods shown in FIGS. 10 and 11 are 
employed. Accordingly, this embodiment aims to solve the 
above problem by coding only information on the difference 
between low-resolution shape data and high-resolution 
shape data. 

FIGS. 3 and 4 are block diagrams respectively showing a 
coding apparatus and a decoding apparatus according to the 
second embodiment. 

The coding apparatus in FIG. 3 differs from the coding 
apparatus in FIG. 1 in that low-resolution shape data in a first ^ ^ 
shape data coding portion 307 are sent to a second shape 
data coding portion 303, and the second shape data coding 
portion 303 codes only information on the difference 
between the low-resolution shape data and the high- 
resolution shape data. 

Other than that, upper layer coding portion 101, second 
shape data generating portion 102, down sampHng portion 
104, lower layer coding portion 105, and first shape data 
generating portion 106 are the same as those in FIG. 1, and 
therefore, description thereof is not repeated. 

The decoding apparatus in FIG. 4 is different from the 
decoding apparatus in FIG. 2 in that low-resolution shape 
data decoded in a first shape data decoding portion 404 are 
sent to a second shape data decoding portion 402, and the 
second shape data decoding portion 402 decodes high- 50 
resolution shape data along with the information on the 
difference. 

Other than that, upper layer decoding portion 201 and 
lower layer decoding portion 203 are same as those in FIG. 
2, and therefore, description thereof is not repeated. In 55 
addition, a lower layer decoding apparatus 405 is equivalent 
to lower layer decoding apparatus 205 in FIG. 2. 

When a quaternary tree is used for representing binary 
shape data, for example, data in the lower hierarchies of the 
tree may be used as the above-described information on the 60 
difference. FIG. 7 shows binary shape data and exemplary 
quaternary tree representation thereof. The uppermost value 
of the quaternary tree is" 1" when at least one pixel value "1" 
exists within a block of 4 pixels by 4 pixels, or "0" 
otherwise. Values at the second and the third hierarchies of 65 
the tree are likewise determined for blocks of 2 pixels by 2 
pixels and of 1 pixel by 1 pixel, respectively. 
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Blocks at respective hierarchies are scanned from above 
left to below right in a raster scan sequence. In the example 
shown in FIG. 7, the shape data in the upper layer are 
expressed with three hierarchies, and the shape data in the 
lower layer are expressed with two hierarchies. The data in 
the third hierarchy is expressed as the information on the 
difference between the upper and lower layers. These data 
expressed with the quaternary tree are coded by arithmetic 
coding, for example. 

When the shape data are expressed with two or more 
layers of gradation, another coding method may be 
employed, in which low-resolution shape data are 
up-sampled to the resolution for an upper layer before taking 
the difference with high-resolution shape data, and the 
difference data are then coded by transformation coding. 

Next, the third embodiment of the present invention will 
be described. 

In the methods described with reference to FIGS. 10 and 
11 as above, low-resolution shape data are obtained by 
thinning out shape data. This may cause a problem that the 
contour of a part image in the lower layer becomes stepwise, 
which results in degradation of the image quality. 

In the third embodiment, the above problem is solved by 
setting up for shape data more layers of gradation than in the 
original shape data, along with thinning out of the shape 
data. 

FIG. 8 A shows a part of binary shape data. FIG. 8B shows 
exemplary shape data transformed to be adapted to a low- 
resolution monitor of which the resolution is halved and the 
pixel size is doubled both vertically as well as horizontally. 
In this example, a 2x2 filter. 



0.25 0.25 
0.25 0.25, 



is applied to a block surrounded by a bold line in FIG. 8 A, 
thereby obtaining low-resolution shape data having five 
levels of gradation of 0, 0.25, 0.5, 0.75, and 1. When an 
element of the above 2x2 filter is represented as f (i, j) and 
an element within a block in FIG. 8 A is represented as d (i, 
j), the filtering operation can be represented as follows: 

£f(i,j)d(i,j) 

wherein 2 represents a sum for i«l, 2 and j=l, 2. If the 
original shape data has N levels of gradation, the filtering 
allows generation of shape data with M(M>N) levels of 
gradation. 

FIG. 8C shows exemplary shape data used for enlarging 
a part image of low resolution for display on a monitor that 
allows display with the same resolution as in FIG, 8A. The 
data can be obtained by simply enlarging the data in FIG. 8B 
by a factor of 2 vertically as well as horizontally. Increasing 
the number of levels of gradation of the shape data in low 
resolution as described above can avoid the stepwise appear- 
ance of the boundary portion. 

The shape data generated in FIG. 8C, for example, can be 
used for superimposing images according to the expression 
(1) described in the Background Art section. In this case, the 
background and the foreground are mixed at the contour 
portion of a part image, thereby making the stepwise pattern 
at the boundary inconspicuous. 

Though the above example has been described using a 
2x2 filler, other filters may be employed, instead. For 
example, a 3x3 filter as follows can be used to transform 
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shape data into a vertically as well as horizontally halved As a decoding apparatus corresponding thereto, the appa- 

version. ratus shown in FIG. 2 can be used as it is. Likewise, when 

this embodiment is adapted to the second embodiment, the 
high-resolution shape data corresponding to a portion of part 
~ ~ 5 image can be generated by the second shape data generating 
1/6 2/6 1/6 portion 102 of the coding apparatus shown in FIG. 3. 
0 1/6 0 whereby the present invention can be implemented. 
In this case, however, a signal line from the first shape 

Here, target pixels for sub-sampHng are, for example, data coding portion 307 to the sca)nd shape data coding 

those shown by Oin FIG. 8(^0. ^° P^'^'*'^ ^ Therefore, there is a need to provide 

FIGS. 5 and 6 are block diagrams respectively showing a ^ ^"^^^^^ ^ ^^^^^^ between the methods described in the 

coding apparatus and a lower layer decoding apparatus ^^^^^ second embodiments. This switch is provided 

according to the third embodiment. They are modifications between the first shape data coding portion 307 and the 

ofthose that are shown in FIGS. 10 and 11, with the portions second shape data coding portion 303. When using the 

for down sampling the shape data being replaced by trans- ^5 method according to the fourth embodiment, the switch is 

forming portions 504 and 602, respectively, turned off and the upper layer shape data (the second shape 

Other than that, first down sampling portion 1001, upper data) are coded independently. When using the method as 

layer coding portion 1003, lower layer coding portion 1004, described in the second embodiment, the switch is turned on 

shape data coding portion 1005, lower layer decoding por- and the information on the difference between the upper 

tion 1101, and shape data decoding portion 1103 are same as 20 layer shape data (the second shape data) and the lower layer 

those in FIGS. 10 and 11, and therefore, description thereof shape data (the first shape data) are coded, 

is not repeated. Por a decoding apparatus, the apparatus shown in FIG. 4 

Transforming portions 504 and 602, each operating iden- is provided with a similar switch, which is disposed on a 

tical to each other transforni shape data mto the ones having ^igml Une comiecting the first shape data decoding portion 

bwer^resolution but more levels of gradation, as shown m ,5 the second shape data decoding portion 402 in FIG. 

Though a 2x2 filter has been used in FIGS. 8A-4JC, many ' .^^ T^h fiT'"^ '° '^l^^u!^^ "^^"T"' 

other filters, such as those of 3x3 or 2x5, can also be used A^Jf J*^' J^^^l ^^T' 

for transformation. ^^^P^ ^^^^ (^^^ ^^^P^ ^^^^) decoded 

Furthermore, in the description of the coding apparatus independently, and the case in which the data representing 

according to the above embodiments, shape data sent to the difference between the upper layer shape data (the 

shape data coding portion have also been sent to the corre- second shape data) and the lower layer shape data (the first 

sponding pixel data coding portion. In that case, however, a ^^^P^ data) are decoded and then the difference data are 

problem will arise when nonreversible coding is performed ^dded to the lower layer shape data (the first shape data) to 

in the shape data coding portion, because the shape data used decode the upper layer shape data (the second shape data), 

in a pixel data coding portion and the shape data used in a 35 According to the motion image coding apparatus and the 

pixel data decoding portion in a decoding apparatus become motion image decoding apparatus according to the above 

different from each other. embodiments, the following favorable effects can be 

In aich a case, the coding apparatus may be provided with obtained: 

a shape data decoding portion, so that the coded shape data (1) Coding and decoding of a part image having spatial 

can be decoded in the shape data decoding portion before 40 hierarchy can be realized. 

being sent to the corresponding pixel data coding portion. (2) In the first embodiment, low-resolution shape data are 

FIG. 9 shows a variation of the coding apparatus in FIG. 3, coded as the shape data for a lower layer. Accordingly, 

which has been inodificd in this maimer. redundancy associated with coding of high-resolution shape 

H.t^tS'K^ ^ l^y^^ be ehminated. Therefore, an 

data that have been decoded by a first shape data deco^^^^ ^5 image in the lower layer can be coded and decoded in 

portion 909 are sent to a lower layer coding portion 905 as ^ • ui ■ i- 

well as to a second shape data coding portion 903 and a ^^"^"^^ ^"^'^^ transmission or 

second shape data decoding portion 908. A decoding appa- capacity. 

ratus corresponding to the coding apparatus shown in FIG. ^^^^ embodiment, mformation on the shape 

9 also uses the decoded data of lower layer shape data at an ^^^^ ^ ^^^^^ ^^y^^ ^ ^^d for coding the shape data in 

upper layer shape data decoding portion, that is a portion ^PP^^ ^^y^^i information on the difference between 

equivalent to the second shape data decoding portion 908 in low- resolution shape data and the high-resolution shape 

FIG. 9. data is coded. Accordingly, data amount necessary for 

Finally, the fourth embodiment of the present invention coding the shape data in the upper layer can be reduced, 

will be described. Therefore, efiBcient coding can be realized in the upper layer. 

The present embodiment is based on the first and second 55 (4) In the third embodiment, upper layer shape data are 

embodiments, but in which an upper layer is configured to transformed to generate lower layer shape data having more 

improve spatial resolution of only a portion of part image levels of gradation. Accordingly, the stepwise boundary 

coded in the lower layer. By this configuration, an area for existing in the contour portion of lower layer shape data can 

a face of a figure can be coded as a part image in the lower be made inconspicuous. Therefore, the contour of a part 

layer, and only the mouth portion can be coded in high 60 image on display becomes smooth, and thus a psychically 

resolution in the upper layer, for example. favorable image can be obtained. 

When the fourth embodiment is adapted to the first (5) In another embodiment of the present invention, 

embodiment, the second shape data generating portion 102 assuming that the upper layer shape data arc smaller than the 

of the coding apparatus shown in FIG. 1 can be used to lower layer shape data, hierarchical coding for improving 

generate high-resolution shape data corresponding to a por- 65 spatial resolution of a part of the lower layer using data in 

tion of part image, and thus the present invention can be the upper layer can be performed. Accordingly, if there is a 

implemented. need to look into the contents of an image only in a portion 
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of the lower layer, or if only a portion in the lower layer has 
a complex texture and has to be displayed in high resolution, 
it is possible to perform an appropriate hierarchical coding. 

INDUSTRIAL APPLICABIUTY 5 

As described above, the present invention enables efiS- 
cient coding and decoding of a part image having spatial 
hierarchy. Accordingly, the present invention is advanta- 
geously applicable to the field of image coding and decoding 
apparatuses. 

What is claimed is: 

1. A motion image decoding apparatus for performing 
hierarchical decoding of an image object, the motion image 
decoding apparatus comprising: 

a lower layer decoding portion decoding the image object 

in low resolution as a lower layer image object; 
an upper layer decoding portion decoding the image 
object in high resolution as an upper layer image object, 
the high resolution being higher than the low resolu- 20 
tion; 

wherein the apparatus decodes an information for switch- 
ing said upper layer image object between 
(i) an image corresponding to said lower layer image 

object with its spatial resolution improved in an 25 

entire region thereof, and 
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(ii) another image corresponding to said lower layer 
image object with its spatial resolution improved in 
only a partial region thereof; and 
receives coded data of said information together with 
coded data of said lower layer image object and coded 
data of said upper layer image object. 
2, A motion image decoding apparatus for performing 
hierarchical decoding of an image object, the motion image 
decoding apparatus comprising: 

a first decoding portion decoding the image object in low 

resolution as a lower layer image object; 
a second decoding portion decoding the image object in 
high resolution as an upper layer image object, the high 
resolution being higher than the low resolution; 
wherein the apparatus switches said upper layer image 
object between 

(i) an image corresponding to said lower layer image 
object with its spatial resolution improved in an 
entire region thereof, and 

(ii) another image corresponding to said lower layer 
image object with its spatial resolution improved in 
only a partial region thereof; and 

receives coded data of said lower layer image object and 
coded data of said upper layer image object from a 
coding device. 

***** 
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